THE ABSENCE OF A PATTERN AND THE NUMBER OF 
OCCURRENCES OF ANOTHER 



MIKLOS BONA 

Abstract. Following a question of J. Cooper, we study the expected 
number of occurrences of a given permutation pattern q in permutations 
that avoid another given pattern r. In some cases, we find the pattern 
that occurs least often, (resp. most often) in all r-avoiding permutations. 
We also prove a few exact enumeration formulae, some of which are 
surprising. 



1. Introduction 

Let q = qiq2 ... % be a permutation in the symmetric group Sk- We say 
that the permutation p = p±p2 ■ ■ ■ p n £ S n contains a q-pattern if and only 
if there is a subsequence Pi 1 Pi 2 ■ ■ - Pi h of p whose elements are in the same 
relative order as those in q, that is, 

Pit < Piu if an d only if q t < q u 

whenever 1 < t, u < k. If p does not contain q, then we say that p avoids 
q. For example, 41523 contains exactly two occurrences of the pattern 132, 
namely 152 and 153, while 34512 avoids 132. See Chapter 14 of [1] for an 
introduction to pattern avoiding permutations. 

It is straightforward to compute, using the linear property of expectation, 
that the average number of g-patterns in a randomly selected permutation 
of length n is where k is the length of q. 

Joshua Cooper [2 J has raised the following interesting family of questions. 
Let r be a given permutation pattern. What can be said about the average 
number of occurrences of q in a randomly selected r-avoiding permutation? 

In this paper, we study this family of questions in the case when r = 132. 
We prove that perhaps surprising result that among patterns of a fixed 
length k, it is the increasing pattern 12 • • • k that occurs least often and it is 
the decreasing pattern k(k — 1) • • • 1 that occurs most often in a randomly 
selected 132-avoiding permutation. 

2. Preliminaries 

The structure of 132-avoiding permutations is well understood. If p = 
P\Pi • • • Pn is such a permutation, and pi = n, then pt > p u must hold for all 
pairs (t, u) satisfying t < i < u. In other words, all entries on the left of the 
entry n must be larger than all entries of the right of n. Indeed, if this does 
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not happen, then ptnp u is a 132-pattern. This property is so central to the 
work carried out in this paper that we illustrate it by Figure EJ 



n 




Figure 1. In a 132-avoiding permutation, all entries preced- 
ing the maximal entry are larger than entries following the 
maximal entry. 



Therefore, if C n denotes the number of 132-avoiding permutations of 
length n, then the numbers C n satisfy the recurrence relation 

n 

(1) C n = Cj—iC n —i, 

1=1 

with Co = 1. Hence the numbers C n are identical to the famous Catalan 
numbers C n = ( 2 ^) /(n+1). See Chapter 6 of Enumerative Combinatorics^ 
for a wealth of information on Catalan numbers. 

It follows from the structural property described in the first paragraph of 
this section that a 132-avoiding permutation either ends in its largest entry, 
or it is decomposable, that is, it can be cut into two parts so that every 
entry that precedes that cut is larger than every entry that follows that cut. 
Indeed, if the maximal entry n is not in the rightmost position, then one can 
cut the permutation immediately after n to obtain such a cut. Note that 
there may be additional ways to cut the same permutation. 

Example 1. The permutation 76834512 is decomposable. One possible cut 
is 768|34512, and another one is 768345| 12. 

This relatively simple structure of 132-avoiding permutations enables us 
to give an exhaustive list of the ways in which a 132-avoiding permutation 
can contain a given pattern. 
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Fact 1. If the 132-avoiding permutation p of length n contains a copy Q of 
the pattern q of length k, then one of the following holds. (Note that q itself 
must be 132-avoiding; otherwise p clearly avoids q.) 

(1) If q is not decomposable, that is, if q ends in its largest entry, then 

(a) either all of Q must be on the left of n, 

(b) or all of Q must be on the right of n, 

(c) or Q must end in n. 

For instance, if q = 123, then in p = 678952134, the subsequence 
678 precedes n = 9, the subsequence 679 ends in 9, and the subse- 
quence 134 follows 9. 

(2) If q is decomposable, that is, when q does not end in its largest entry, 
and q does not start with its largest entry, then 

(a) either all of Q is on the left of n, 

(b) or all of Q is on the right of n, 

(c) or the part of Q that precedes a given cut is on the left of n and 
the part of Q the follows that cut is on the right of n, 

(d) or the part of Q preceding k is on the left of n, the part of Q 
following k is on the right of n, and the maximal entry k of Q 
coincides with n. 

For instance, if q = 231, then in p = 786923451, the subsequence 
786 precedes 9, the subsequence 241 follows 9, the subsequence 785 
has its entries 7 and 8 before 9 and its entry 5 after 9 (corresponding 
to the cut 23|1), and the subsequence 895 starts before 9, uses 9, 
and ends after 9. 

(3) If q is decomposable and q starts with its largest entry k, then 

(a) either all of Q is on the left of n, 

(b) or all of Q is on the right of n, 

(c) or the part of Q that precedes a given cut is on the left of n and 
the part of Q the follows that cut is on the right of n, or 

(d) Q starts with n, and the rest of Q is on the right of n. 

3. Increasing Patterns 

Before proving that among all patterns of length k, it is the increasing 
pattern 12 • • • k that occurs least often in 132-avoiding permutations, we 
prove a few general facts about the total number of increasing patterns in 
these permutations. 

3.1. A formula for increasing patterns. Let a n ^ be the total number 
of 12 • • • /c-patterns in all C n permutations of length n that avoid 132. So 
for instance, 02,1 = 4, 0,3^ = 15, and 02,2 = 1- 

Our goal in this subsection is to provide an explicit formula for the gen- 
erating function Ak{x) = ^2 n a n ,kX n . We will use the well-known (see for 
instance Chapter 14 of pQ) explicit formula for the generating function of 
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the Catalan numbers, 



n>0 



We will prove the following theorem. 

Theorem 1. We have 
(2) 



A t (s) = £ nC n / = £ f 2 ") * n " E ^ 



x 



. x , VT^4^ 2x 

n>l n>l n>l 

Furthermore, for all positive integers k > 2, we have 

(3) ^ 

= {^SkV = ( - £T = - 41 

Proof. For fc = 1, the claim is obvious, since an increasing subsequence of 
length one is just an entry of a permutation. 

For larger k, an increasing subsequence of length k is an indecomposable 
pattern. Hence the ways in which it can occur in the 132-avoiding per- 
mutation p are listed in case (1) of Fact 1. This leads to the recurrence 
relations 

n n 
a n,k = 2 X^ aj_i 5 fcC n _i + dj-i^-iCVi-j, 
i=l i=l 

or in terms of generating functions, 

(4) A k {x) = 2xA k (x)C{x) + xA k ^ 1 (x)C(x) 

and our claim follows by induction on k. □ 

Note that in particular, ([3|) implies that for 1 < k < I we have 
(6) A k {x)Ai(x) = A fc+ i(x)A { _i(x). 

3.2. Why the Increasing Pattern is Minimal. For a given pattern q, 
let t n (q) denote the number of all occurrences of the pattern q in all 132- 
avoiding permutations of length n. So in particular, if q is the increasing 
pattern 12 • • • k, then t n (q) = a n>k - 

The main result of this section is the following theorem, which shows 
that no pattern of a given length occurs less often in the set of 132-avoiding 
permutations than the increasing pattern of that length. 

Theorem 2. Let q be any pattern of length k. Then for all positive integers 
n, we have t q (n) > a n<k . 

Before proving the theorem, we need to introduce some simple machinery 
to simplify notation. 
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Definition 1. Let G{x) = Y^ n >o 9nX n and H(x) = Y2 n >o ^nX n be two power 
series. We say that G(x) < H(x) if g n < h n for all n > 0. 

Proposition 1. Let G{x), H{x) and W(x) be three power series with non- 
negative real coefficients so that G(x) < H{x) holds. Then 

G{x)W{x) < H(x)W{x). 

Proof. The coefficient of x n in H(x)W(x) — G(x)W(x) is 

n 

/Xhi - 9i)w n -i, 
i=o 

which is a sum of non-negative real numbers, and is hence non- negative. □ 

We can now return to the proof of Theorem [2j 

Proof, (of Theorem[2]) We prove the statement by induction on k. For k = 1, 
the statement is obvious. 

Now let us assume that the statement is true for all positive integers less 
than k, and prove it for k. We distinguish three cases. Each of these cases 
will be handled by analyzing recurrence relations, which may sometimes 
seem somewhat cumbersome. Therefore, at the beginning of each case, we 
will give an intuitive description of that case. 

In a permutation p = p\P2 • • -p n , we say that i is a descent if pi > Pi+i- 
Otherwise, we say that i is an ascent. 

An overview of the cases is as follows. First, we treat patterns ending in 
their largest entry. Then we treat patterns that contain only one descent, 
say in position j. Finally, we treat all remaining patterns, comparing the 
patterns whose first descent is in position j to the pattern whose only descent 
is in position j. 

See Figure E2] for an illustration. 




Figure 2. Three types of patterns that we compare. 
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Case 1 When q ends in its largest entry k. Let q' be the pattern obtained 
from q by removing the largest entry k from the end of q. We then 
show that q is more frequent than 12 • • • k by showing that q can 
be contained in a 132-avoiding permutation in the same ways as 
12 • • • k, and then using the induction hypothesis. In other words, 
the difference between a n: k and t n (q) is caused by whatever happens 
before the last position of these patterns. 

The possible ways in which q can occur in a 132-avoiding per- 
mutation p are listed in case (1) of Fact 1. Therefore, we have the 
recurrence relation 

n n 

t n (q) = 2^\ i _i(<?)C n _i + 2jtj-i(g')C w -j, 

i=l i=l 

leading to the generating function identities 

T q (x) = 2xC(x)T q (x) +xC(x)T q ,(x), 

Comparing formulae ([!]) and (|7|), we see that T„(x) is obtained from 
T q i{x) by the same operation as A^{x) is obtained from Ap.-i(x), 
namely by a multiplication by the power series F(x) = 1 ^2xC{x) • ^ s 

[x n ]T q ,(x) = t n (q') > a nifc _! = [x n ]A k ^(x) 

by our induction hypothesis, and F(x) = Yln>i Cn-i)^ nas non_ 
negative coefficients, our claim is immediate by Proposition [TJ 
Case 2 Let us now consider the case in which q does not end in its largest 
entry k, and the only descent of q is in the position in which k occurs. 
We will subsequently see that all remaining cases will easily reduce 
to this one. Let us say that k is in the jth position in q, with j < k. 
That is, q = qkj = (k— j + l)(k — j + 2) • • • kl23(k — j). For instance, 
q 7 3 = 5671234.' We will show that 

(8) t n (q kjj ) >t n (l2- ■ ■ k) = a n:k . 

The main idea is the following. The pattern q k ,j looks very similar 
to the increasing pattern, hence the ways in which qj~j can be con- 
tained in a 132-avoiding permutation are also similar to the ways in 
which the increasing pattern can. So the numbers t n (qkj) and a nj k 
satisfy very similar recurrence relations, and where they differ, they 
differ in the way we predicted. 
Subcase 2.1 Let us assume first that j ^ 1, that is, that k is not in the 
first position in q k j- As q k j is decomposable by a cut after the 
jth position, the ways in which q^j can be contained in a 132- 
avoiding permutation are described in case (2) of Fact 1. That 



THE ABSENCE OF A PATTERN AND THE NUMBER OF OCCURRENCES OF ANOTHER 



list leads to the recurrence relation 

n n 

(9) tn(qkj) = 2 Cj-it n -i(qk t j) + ^ ai-ija n -j t k-j 

i=l i=l 

n 

(10) + E 

2=1 

and hence 

T g fc ,,( x ) = 2xC ( x ) T q k ,j( x ) + xA j (x)A k _ j (x) + xA j ^ 1 (x)A k ^j(x), 

hU rp xAk.jjx^Ajjx) + Aj^jx)) 

[ ' J 'w lIJ " l-2xC(x) 

We need to show that T qkj (x) > A)-(x). Comparing formulae 
([3]) and (fTTj) . that is equivalent to 



1 - 2xC(x) 



or 

.r 



(12) l-2xC(x) Mx)2{F{x)k ~ Z + F{x)k ~ 2) ~ M*)m k - 1 - 

Inequality (|12p will be proved if we can show that 

(13) l-2xC{x) Mx)il + F{X)) ~ F{X? - 

Indeed, (fl~3j) implies (fl~2|) by Proposition [fl choosing W{x) 
F k ~ 3 (x). On the other hand, (fl~3j) is equivalent to 

x x 111 11 

+ 7T7^ - T7^ 1 — \ + T > 



2(l-4x) 3 /2 2(1 -4x) 4(1 -4c) 4 ~ 4(1 - 4x) 2 V / T^ r 4x" 4' 

r X — 1 1 

+ ^ : — r + ; > 0. 



2(1 - 4x) 3 / 2 2(1 - 4x) 2 V / T^4x" 

The coefficient of x n on the left-hand side is0ifn = 0, n = 1, 
or n = 2, and is b n = { 2 ^)(2n - 1) - 3 • 2 2 ™" 3 + ( 2 ^) if 
n > 3. If we replace n by n + 1, the negative summand in the 
above expression of 6 n , that is, 3-2 2 ™ -3 , grows fourfold, whereas 
a routine computation shows that the sum of the two positive 
terms grows 4n '>~!~n 4r ^ 6 -fold, This fraction is larger than 4 for 
all n > 3, showing that 6„ > for all n, and our claim is proved. 
Subcase 2.2 If j = 1, then a minor modification is necessary since if a copy 
of q contains n, then it has to start with n. Hence formula ([9]) 
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becomes 

n n 

(14) t n (q kA ) = 2^C , i _it n _ i (g M ) + ^ 

i=l i=l 
n 

(15) + 

So only the last sum is different from what it was in ([9]). This 
leads to the generating function identities 

T qkl (x) = 2xC(x)T qkA (x) + xA k „ 1 (x)(A 1 (x) + C(x)), 

nr i \ - ^fc-i(^)(^i(g)+C(a)) 
Ubj J, » W " l-2xC(s) 

Comparing formulae Q and ([To]) , the inequality j4fc(x) < T g& x (x) 
is now proved by Proposition since C(x) < A\(x) + C{x). 
Case 3 Finally, there is the case when k is in the jth position of q for some 
j < k, but j is not the only descent of q. We claim that then copies 
of q occur even more frequently than copies of q k j, roughly because 
even in segments where q k j is increasing, q is not. 
That is, we will prove that 

(17) t n (q k)j ) < t n (q). 

This, together with ([8]) will complete the proof of Theorem [2l 

As q is decomposable by a cut after its jth position, the ways 
in which q can be contained in a 132-avoiding permutation are de- 
scribed in case (2) of Fact 1. Let g <1> denote the pattern formed 
by the first j entries of q, and let q <2> be the pattern formed by the 
remaining k — j entries of q. Then we have the recurrence relation 



<2>n 



t n {q) > 2 Ci-^i^+Y, t i . 1 (q <1> )t n ^ i (q <2> )+Y U-iiq^^K-iiq 

i=l i=l 1=1 

Here q <l > is the pattern obtained from q <l> by removing its last 
(and also largest) entry. Note that t n (q) is at least as large as the 
right-hand side, and not necessarily equal to it. That is because, 
unlike q k j, the pattern q may be decomposable by other cuts, in 
addition to the cut after its jth entry. The existence of such cuts 
would add extra summands to the right-hand side. 

The last displayed inequality leads to the generating function in- 
equalities 

T q {x) > 2T q (x)xC(x) + xT q< i> (x)T g <2> (x) + xT g<1 > > (x)T q <2>(x), 
T g (x)(l - 2xC(x)) > xT q i(x)T q 2(x) + xT ' <x > > (x)T q <2> (x). 
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Note that as 1/(1 - 2xC{x)) = - Ax = Y^ n > ( 2 ™)z n has non- 

negative coefficients, the last displayed inequality remains true if we 
multiply both sides by 1/(1 — 2xC(x)). This leads to the inequality 



(18) TJx) > 



xT q <2>(x)(T q <i> +T g<1/> (x)) 
1 - 2xC{x) ' 



We can now compare formulae (jlip and (|18p . We see that by our 
induction hypothesis, each factor on the right-hand side of (|18p is 
at least as large as the corresponding factor on the right-hand side 
of (fTTj) . That is, xT q <2>{x) > xAk-j(x), since q <2> is a pattern 
of length k — j, and T q< i> + T ?<1 / > (x) > A^{x) + Ak-\{x) by a 
summand-wise comparison. Hence, by Proposition HJ we have that 
T q {x) > T qkj (x), and the proof of Theorem [2] is complete. 

□ 



4. Why the decreasing pattern is maximal 

In this section we prove that the decreasing pattern k(k — 1) • • • 21 oc- 
curs more frequently in 132-avoiding permutations than any other pattern 
of length k. The structure of the proof will be very similar to that of the 
minimality of the increasing pattern, but there will be more technical diffi- 
culties. 

Let d n: k denote the number of decreasing subsequences of length n in all 
132-avoiding permutations of length n. Then we have 

d n ,i = a n i = nC n = n [} ■ 
n+ 1 \ n J 

For larger values of k, consider the set of all C n permutations of length n 
that avoid 132. In that set, for every 1 < j < k — 1, there are 

n 

^ d%— l,jd n — % t k— j 

1=1 

copies of k(k — 1) • • • 1 in which the first j entries are on the left of n, 
and the last k — j entries are on the right of n. (The index i denotes the 
position of the entry n in a permutation of length n.) In addition, there are 
Y27=i Ci-l^n fc-l copies of k{k — 1) • • • 1 that start with the entry n. Finally, 
there are the 2 ^™ =1 Ci-\d n ^i^ copies of k(k — 1) • • • 1 that are either entirely 
on the left of n, or entirely on the right of n. This leads to the recurrence 
relation 

fc— 1 n n n 

(19) d n> k = di-l,jdn-i,k-j + 5^ Cj-l^n,fc-l + 2 ^2 Gi-ldn-i,k 

j=l i=l i=l i=l 
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and the generating function identities 

fc-1 

D k (x) = 2xC(x)D k (x) + xC(x)D k _ 1 (x) + Y,xD j (x)D k _ j (x), 

3=1 

xC(x)D k ^ 1 (x) + T!]ZlxD j {x)D k _ j {x) 
(20) D k {x) = 



1 - 2xC{x) 

The following Corollary provides an estimate for the "growth" of the 
power series D k {x). It is worth comparing its result with Theorem [TJ 

Corollary 1. We have 

xDi(x) 



(21) D 2 {x) = 
and 

(22) D k (x) > 



(1 - Ax) 
for k > 3. 

Proof. The first displayed identity (the special case of k = 2) immediately 
follows from ([20]) if we recall that 1 — IxCix) = y/1 — 4x and that Di(x) + 

The general formula (j22H follows from (|20H if we remove all summands 
from the right-hand side except for xC(x)D k ^i(x) and xD\{x)D k _i, (we 
can do this since all the removed terms have non- negative coefficients), and 
then again, we recall that D\{x) + C(x) = ^i_ ix ■ D 

The following Lemma is a natural counterpart of its much simpler ana- 
logue © . It shows that the sequence of power series D\ (x) ,D2(x),--- is 
log-convex in a certain sense. 

Lemma 1. For all positive integers 2 < a < b we have 

D a (x)D b (x) < D a ^{x)D b+1 {x). 

Proof. Induction on a + b. The smallest value of a + b for which the state- 
ment is not trivial is 4. The non-trivial statement then is that D2(x) 2 < 
Di(x)Dz(x). By (P), this is equivalent to D^x) 2 < D x {x)D s {x). In 

order to prove the latter, it suffices to show that 

2 

Dl{x) jrhxj - D3(x) ' 

and that is immediate by (I21D , 

Now let us assume that the statement holds for a + b = m — 1 and prove 
it for a + b = m. By (I20p . it suffices to show that 

6-1 

D a (x)C(x)D b ^ 1 (x) + Y J D a (x)D :j (x)D b ^(x) < 
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b 

< D a ^C{x)D b {x) + Y J D a -i(x)D 3 {x)D b+1 _ j (x). 
j=i 

Note that the right-hand side has one more summand than the left-hand 
side. Now we carry out a series of pairwise comparisons. First, for the two 
terms preceding the summation signs, we have that D a (x)C(x)D b _i(x) < 
D a -\{x)C{x)D b (x) since C{x) has non-negative coefficients, and by our in- 
duction hypothesis, D a {x)D b _\{x) < D a -i{x)D b (x). For the terms after the 
summation signs, for j < a, we have that 

D a {x)D j {x)D b _ j {x) < D a ^ 1 {x)D j (x)D b+1 _ j {x) 

since our induction hypothesis implies that D a (x)D b ^j(x) < D a ^i(x)D b+ i^j(x). 
The induction hypothesis applies since a + b — j < a + b. 
For a < j < b — 1, we claim that 

D a (x)D j (x)D b ^(x) < D a _i(x)Dj + i (x)D b _j (x). 

(That is, we skip one summand, and we compare the jth summand of the 
left-hand side to the (j + l)st summand to the right-hand side.) Indeed, 
our induction hypothesis implies that D a (x)Dj(x) < D a ^i(x)Dj + i(x). The 
induction hypothesis applies since a + j < a + b. 

With this, each summand of the left-hand side was injectively associated 
to a weakly larger summand of the right-hand side, proving our claim. □ 

Now we are in a position to state and prove the main result of this section. 

Theorem 3. Let q be a pattern of length k. Then the inequality 

t n (q) < d rhk 

holds. 

Proof. We prove the statement by induction on k and n. We know that the 
statement holds for k = 1 and it is routine to verify it for k = 2. Let us now 
assume that it is true for all patterns shorter than k. Let us further assume 
that for patterns of length k, the statement holds for all permutations shorter 
than n. (The initial cases of n < k are obvious.) Let us now prove that the 
statement hold for permutations of length n, and patterns of length k. 

Again, our proof proceeds by cases. We first handle patterns that start 
with their largest entry, then patterns which contain only one ascent, in 
position j. Finally, we cover the remaining cases, comparing patterns whose 
first ascent is in position j to the pattern whose only ascent is in position j. 
See Figure |4] for an illustration of some of these cases. 

Case 1 Let us first consider the case when q starts with its largest entry k. 
In this case, simply use the fact that the pattern obtained from q 
by removing its first entry occurs less often than the pattern k(k — 
1) • • • 21, and it is decomposable by no more cuts than k(k— 1) • • • 21. 

In this case, q is decomposable since it can be cut right after its 
first entry. Let us say that q is decomposable with v distinct cuts, 
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Figure 3. Three kinds of patterns we compare. 



and let q 1 ^ and q 1 ^ denote the patterns before and after the first 
cut, let q 2 ^ and q 2,b denote the patterns before and after the second 
cut, and so on, up to q°» and q v,b for the patterns on the two sides 
of the last cut. (The letters / and b stand for "front" and "back".) 

Note that the total length of qi" and q^ b is always k for every j, 
and that = 1 and \q^' \ = k — 1. 

Then we have the recurrence relation 

(23) 

v n n n 

j=l 1=1 1=1 1=1 



It is now straightforward to compare d n ^ and t n (q) by comparing 
the corresponding summands of recurrence relations (|19p and (|23|) . 
Let us first compare the two double sums. In those sums, j indexes 
the cuts of the respective patterns. As the decreasing pattern of 
length k has k — 1 cuts, j ranges from 1 to k — 1 in (|19p . In (|23[) . 
j ranges from 1 to v, where v < k — 1 is the number of cuts that 
q has. So the first double sum has more terms. We also claim that 
even the terms that the second double sum does have are smaller 
than the corresponding terms in the first double sum. 

Indeed, if \q^'^\ = y and \q^' b \ = k — y, then U-i(q : '^) < di-i,y and 
t n -i(q j,b ) < d n -i, k -y by our induction hypothesis, sot i _ 1 (q jJ )t n _ i (qi' b ) < 
di—l,ydn—i,k—y 

Comparing the second sums of (I19p and (I23D is even simpler. Their 
summands agree in the term Cj_i, and by our induction hypothesis, 
we know that t n _i(q 1,b ) < d n -i^-i- Finally, comparing the third 
sums of (fT9l) and (|23|) we use the fact that n — i < n, so by our 
induction hypothesis, t n -i{q) < d n -i t k- 
Case 2 When q has only one ascent and q does not start with its largest 
entry k. Just as in the previous section, this is the heart of the 
proof. The remaining cases will easily reduce to this one. Let q k,h 
be the pattern of length k that avoids 132 and has only one ascent, 
in position h. As q does not start in its largest entry k, this means 
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that k must be the (h + l)st entry of q. That is, 

q k,h = (fc _ i) . . . (fc _ h)k(k -h-1)--- 321. 

For instance q 5,2 = 43521. 

The difficulty of this case is that there is a way in which q k,h can 
be contained in a 132-avoiding permutation in which k(k — 1) • • • 21 
cannot, namely by having h entries on the left of n and k — h — 1 
entries on the right of n. As we will see, the ways in which the 
decreasing pattern can be contained in such a permutation and q k,h 
cannot are more prevalent, but that is not obvious. We will need 
Lemma Q] to prove that fact. 

The structure of q k ' h is somewhat similar to that of the decreasing 
pattern. That is, q k ' h can be cut after each entry starting with k (in 
position h+1). Cutting immediately after position j (with j > h+1) 
will result in the two patterns q^ h and the decreasing pattern of 
length k — j. This leads to the recurrence relation 

(24) 

fc— 1 n n n 

tn{q k,h ) = £ ^ tj~l(q : ' ,h )dn-i,k-j+y^ J ^-l,/t^n-i,fc-ft-l+2 £ Cj-it n _i(q k,h ) 
j=h+l i=l i=l i=l 

We can carry out a pairwise comparison of corresponding sums in 
formulae (|19p and (|24p . This is easiest for the third sums in those 
two formulae: indeed, as n — i < ra, our induction hypothesis implies 
that t n -i(q k ' h ) < d n _i^ for all k, i, and h, so the third sum appearing 
in (|19p is larger than the third sum appearing in (|24p . 

As far as the double sums are concerned, for j = h + l,h + 
2, • • • , fc— 1, our induction hypothesis implies that ti_i(qi ,h ) < dj-ij. 
Therefore, each term of the double sum of (|24p is at most as large 
as the corresponding term of (fTUl) . 

Therefore, the claim t n (q k ' h ) < d n ^ will be proved if we can show 
that the remaining sum in (|24p is less than the remaining sums in 



I9j) . that is, that 
di-l,hdn-i,k-h-l — ^2 ^2 dj,i-ld n -i,k-j + ^2 Ci-id 



n h 
J2<< ■ ■<> < ^ \ ' 

i=l j=l i=l 



l"Tlr 1" 



We show the stronger statement that the above inequality remains 
true even if we remove all summands from the double sum in which 
j 7^ 1. (Note that as k is not in the first position of q, we know that 
h— 1 > 1, so this will leave a non-empty set of summands.) In other 
words, we claim that 



£4 

1=1 



-l,h 



,k-h-l 



< 



di--\.-\ d, 



l,l a n-i,fc-l 



+ £ Ci-id n . 



fc-1- 



i=l 



i=l 
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This is equivalent to the generating function inequalities 

xD h (x)D k _ h _x(x) < xD 1 (x)D k _ 1 (x) + xC(x)D k _ l {x). 

D h (x)Z> fc _ h _i(x) < L> fc _i(x)(l - 4x)- x / 2 . 
By Lemma [H we know that Df l (x)D k _f l _i(x) < Di{x)D k „2{x), so 
it suffices to prove that 

L>i(x)D fe _ 2 (x) < D fe _!(x)(l - 4x)- x / 2 . 

By CorollaryOn we know that D k -2(x) < -Dfc_i(x), so our claim 
will be proved if we can show that 

x 



DAx) < 



(1 - Ax) 3 / 2 ' 



The last displayed inequality holds since [x n ]Di(x) = ^-j- ( ^) whereas 
[x n ] ( 1 _ 4 ^3/2 = — l)(^T-i 2 )- A routine computation shows that 
the latter is larger as soon as 2 < n + 1, or 1 < n. 
Finally, we consider the case when q has more than one ascent, and 
q does not start with its maximal entry. Let us assume that the 
maximal entry k of q is in the /ith position. We will show that then 
tn{o) < tn{q k,h )- The main idea behind the proof is that q k,h is 
decomposable at every place where q is, and after decomposition, its 
parts are close to the decreasing pattern. 

Let us inductively assume that we know the statement t n (q) < 
t n (q k,h ) for all patterns shorter than k. 

The set of positions after which q can be cut is a subset of the 
set of positions after which q k,h can be cut. Just as in Case (1), let 
us say that q is decomposable with v distinct cuts, and let q 1 ^ and 
q l,b denote the patterns before and after the first cut, let q 2 ^ and 
q 2,b denote the patterns before and after the second cut, and so on, 
up to q v ^ and q v,b for the patterns on the two sides of the last cut. 
Note that \q 1J \ = h and = k - h. 

Then, similarly to Case (1), we have the recurrence relation 



j=l i=l i=l i=l 

where q 1 ^' is the pattern q 1 ^ with its last (and largest) entry re- 
moved. 

The inequality t n (q) < t n (q k,h ) is now obvious by pairwise com- 
paring the three summands in (|24p and (|25p , and using the induction 
hypotheses. (In particular, when comparing the first summands, we 
use the fact that if \q j > h \ = \q jJ \, then > t i _i(g i ' /l ) by the 

induction hypothesis made in this case. Recall that we assumed that 
for patterns q shorter than k, it is true that t n (q) < t n (q^' h ), where 
h is the first ascent of q.) 
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□ 

5. Asymptotic Enumeration 

Theorem [T] provides an explicit formula for A2(x). From that formula, it 
is routine to deduce that 

(26) a "' 2 " 2 -4U + iJ~2^ + TUJ 

for n > 1. 

Similarly, an explicit formula for D2(x) can be obtained by setting k = 2 
in (j2DD. That is, 
(27) 

xC{x)Di(x) +xD 1 (x)D 1 {x) _ x I I 

2(X) ~ 1 - 2xC(x) ~ (1 - 4x)3/ 2 ~2(1 - 4x) + 27T^Ir 

This yields 

(28) dn2= ^J^ (n + i)_ 2 ^i 

for n = 1. 

Comparing formulae f|26j) and f|28j) and using Stirling's formula, we see 
that in 132-avoiding permutatations of length n, there are Cy/n times as 
many inversions as non-inversions. 

For larger values of k, it would be perhaps tempting to think that in- 
creasing patterns of length k become very rare, since they are the rarest of 
all patterns of length k. However, Theorem [1] shows that a n ^ is of expo- 
nential order 4, since the dominant singularity of Ak{x) is at 1/4. In fact, 
Theorem Q] implies that Ak{x) is a sum of various powers of (1 — Ax), the 

k 

dominant of which is (1 — 4x)~2 . It then follows from singularity analysis 

k-2 

that a n ^ ~ c • 4 n 2 . 

6. Further Directions 

A simple analysis of the proofs of Theorems [2] and [3] show that the in- 
equalities a(n, k) < t n (q) < d(n, k) are sharp is n is large enough compared 
to k. 

We have seen that if we consider 132-avoiding permutations, then among 
all patterns of length k, the increasing pattern is the least likely to occur 
and the decreasing pattern is the most likely to occur. This suggests the 
following natural question. 

Question 1. Let r be any pattern, and let t r ^ q {n) be the number of all copies 
of q in all r-avoiding permutations of length n. Let us assume that among 
all patterns q of length k, it is the increasing pattern that minimizes t Tt q{n) 
for all n. 

Is it then true that among all patterns q of length k, it is the decreasing 
pattern that maximizes t r ^ q {n)? 
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Another direction of research is the following. 

Question 2. Let q\ and q 2 be two patterns of the same length, and assume 
that for some positive integer N, the inequality 

t rm {N) < t rm (N) 

holds. Is it then true that 

t r , qi (n) < t r , q2 (n) 

for all n > N? 

In other words, is it true that the relation between the frequency of q\ 
and qi in r-avoiding permutations depends only on r, q\ and q2, or does it 
depend on n as well? 

Lemma [U and formula [6] show interesting combinatorial properties of the 
power series Di(x), D 2 (x), ■ ■ ■ and Ai(x),A 2 (x), ■ ■ ■ . These properties are 
easy to express in terms of combinatorial objects, without power series. 
However, is there a combinatorial proof for them? 
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